# Large - scale corpus

IndoBERT is the state - of - the - art Indonesian language model based on the BERT model, trained through masked language modeling and next - sentence prediction objectives.